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EXPERIMENTAL  DESIGNS  FOR  SIMPLE  PLANTING  AND  OTHER 
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By 
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Research  Forester 


Practicing  foresters  frequently  find  situations  in  which  either 
necessity  or  natural  curiosity  impels  them  to  experiment.    This  desire 
may  he  stimulated  by  dissatisfaction  with  an  accepted  practice  and  an  idea 
on  how  to  do  it  better.    Or  it  may  be  caused  by  uncertainty  about  how  to 
do  a  job  to  get  acceptable  results.    Practically  always  the  obvious  step 
is  to  try  one  or  more  methods  to  see  how  well  they  accomplish  the  desired 
result. 

This  report  describes  some  experimental  designs  that  field  for- 
esters need  when  they  try  new  or  different  methods  of  artificial  reforest- 
ation.   These  suggestions  are  based  on  many  years  of  experience  and  observa- 
tion.   They  point  out  the  essential  requirements  of  experimental  design 
that  will  permit  the  drawing  of  reliable  conclusions,  and  some  pitfalls 
which  must  be  avoided.     One  section  of  this  report  shows  five  sample 
designs  that  can  be  modified  or  adapted  to  a  considerable  variety  of  prob- 
lems.   The  last  section  explains  some  principles  of  data  analysis. 

PRINCIPLES  OF  EXPERIMENTAL  DESIGN 

KNOWLEDGE  OF  THE  SUBJECT  FIELD 

Anyone  who  undertakes  an  experiment  without  first  making  a 
reasonably  thorough  search  for  information  runs  a  good  chance  of  needlessly 
studying  problems    which  have  already  been  adequately  investigated. 
Searches  for  information  can  be  made  in  libraries  of  forestry  and  related 
arts  and  sciences,  such  as  horticulture  and  botany.    Recognized  authorities 
also  can  be  consulted.    Many  planting  experiments  have  been  duplicated 
unnecessarily. 

DETERMINATION  OF  THE  PROBLEM 

Efficient  experiments  demand  a  clearly  defined  objective.  The 
object  must  be  stated  in  a  form  that  will  give  a  reasonably  decisive  an- 
swer with  the  facilities  and  skills  that  are  available.     Poorly  defined 
experiments  can  be  compared  to  a  novice  rearranging  the  wires  in  a  radio. 
The  result  may  be  better  performance  by  the  radio,  but  the  odds  are  very 
much  against  it.    Rarely  should  experiments  be  undertaken  for  the  vague 
purpose  of  "to  see  what  will  happen. " 


SYMMETRY  IN  DESIGN 


For  simple,  straight -forward  results,  all  of  the  elements  in  a 
study  should  be  balanced.    For  example,  if  50  trees  are  given  a  treatment 
such  as  shading,  an  equal  number  of  identical  trees  (same  seed  lot,  same 
age,  same  nursery,  etc.)  should  be  left  unshaded  or  given  a  different 
degree  of  shading  as  a  check  or  comparison.    Another  example:    In  a  more 
complex  experiment  Involving  two  species  and  two  degrees  of  shading,  equal 
numbers  of  the  two  species  must  be  used,  and  half  of  each  of  these  must 
be  subject  to  the  two  degrees  of  shading  as  shown  below. 

Species  Trees  Treatments 

(number)  25  percent  shade    50  percent  shade 

(number) 

Ponderosa  pine        50  25  25 

Jeffrey  pine  50  25  25 

CONFOUNDING 

Confounding  in  experimental  design  means  having  two  conditions 
affecting  a  result  in  such  a  way  that  the  individual  effect  of  each  cannot 
be  separated.    For  example : 

Species  Date  of  Planting  Survival  after  1  year 

(percent) 

Ponderosa  pine  November  i960  60 

Jeffrey  pine  April  1961  80 

Which  caused  the  higher  survival- -the  greater  hardiness  of  Jeffrey  pine 
or  the  time  of  planting?    This  example  may  be  so  obvious  that  it  appears 
to  insult  the  reader's  intelligence,  but  it  is  one  of  the  greatest  pit- 
falls for  the  uninitiated  in  experimental  design.     Confounding  often  occurs 
much  more  subtly  than  in  the  above  example.     The  possibilities  for  confound- 
ing are  almost  limitless—source  of  seed,  site,  aspect,  planters,  planting 
methods,  stock  ages  or  handling,  and  protective  measures,  including  screen- 
ing seed  spots.    Furthermore,  accidents  of  nature,  such  as  deer  browsing 
or  insect  damage,  can  confound  an  experiment. 

REPLICATION 

To  replicate  means  to  make  more  than  one  installation  of  an 
experiment.    Six  replications  in  an  experiment  includes  six  counterparts. 
The  simplest  explanation  of  the  reason  to  replicate  is  to  increase  the 
opportunity  for  the  treatments  to  give  consistent  results.     If  we  observe 
the  same  reaction  from  several  or  many  independent  repetitions  of  the  same 
test,  we  gain  greater  confidence  that  the  result  is  actually  a  consequence 
of  the  treatment  instead  of  an  accidental  coincidence.    Obviously,  the  more 
replications,  the  higher  the  degree  of  confidence.    From  the  results  of  a 
properly  designed  experiment,  the  degree  of  statistical  confidence  in 
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results  can  "be  calculated.    For  example,  you  can  tell  whether  such  a  situa- 
tion might  "be  expected  frequently  or  as  infrequently  as  once  in  20,  the 
95  percent  probability  level.    Replication  is  an  essential  requirement  for 
efficient  experimentation. 

The  actual  number  of  replications  to  use  in  a  test  is  more  diffi- 
cult to  determine.     It  depends  upon  the  inherent  variability  in  the  subject 
material,  accidents,  the  margin  of  difference  in  response  between  the  vari- 
ous treatments  in  an  experiment,  and  the  degree  of  confidence  in  results 
that  is  desired.    For  planting  tests,  3  to  6  replications  will  usually  be 
enough  to  estimate  the  statistical  significance  and  to  judge  the  practical 
use  of  differences  between  treatments  such  as  Jeffrey  pine  vs.  ponderosa 
pine,  1-0  vs.  2-0  stock,  and  shaded  vs.  unshaded.     One  complete  installa- 
tion (or  replication)  of  all  treatments  is  called  a  block. 


RANDOMIZATION 


To  randomize  in  experimental  design  means  to  assign  the  treat- 
ments to  different  plots  within  a  block  by  a  method  which  allows  an  equal 
chance  for  each  treatment  to  fall  on  any  given  plot.    Randomization  elim- 
inates both  mechanical  arrangement  of  treatments  and  personal  bias  in 
assignment.    Anyone  who  wishes  to  understand  the  reasons  should  consult 
publications  on  statistical  analyses.     Randomization  is  an  essential  pre- 
requisite both  to  good  experimental  design  and  statistical  analysis  of 
results.    Randomization  can  be  done  by  drawing  numbers  from  a  hat  to 
determine  the  order  of  arrangement,  or  by  other  equally  simple  systems. 
The  plots  in  one  block  may  be  arranged  by  some  systematic  plan  if  it  will 
be  convenient  or  desirable  for  demonstration. 

SIMPLICITY  OF  DESIGN 


The  simpler  and  the  fewer  the  comparisons  in  an  experiment  the 
easier  a  study  can  be  designed,  and  the  better  the  chances  are  to  obtain 
decisive  results.    More  than  three  variables  in  a  single  experiment  prob- 
ably should  be  viewed  with  suspicion.     Consider  the  following  test: 


Factor  Number  of  variables 

Species  3  (J.P.,  P.P. ,  S.P.J 

Planting  method  2  (hand  vs.  machine) 

Site  preparation  2  (machine  clearing  vs. 


unc 


leared) 


Sample  size  25  (trees  per  plot) 

Replications  k  (blocks) 

Total  number  of  trees  =3x2x2x25x4=  1,200 

Thus  it  is  seen  that  this  relatively  modest,  simple  experiment  grows  into 
a  rather  big  job  to  lay  out,  install,  protect,  and  measure.     If  another 


variable  such  as  two  age -classes  had  "been  added,  the  number  of  trees  would 
have  jumped  to  2}k00.     By  reducing  the  number  of  replications  to  3,  how- 
ever, the  total  could  be  cut  to  1,800  trees. 

SAMPLE  SIZE 

Because  seeds  and  seedlings  are  inherently  variable  organisms, 
we  generally  need  to  base  estimates  for  each  independent  sample  on  the 
average  or  sum  of  several  organisms.    Large  samples,  say  100  seed  spots 
or  planted  trees  per  plot,  will  give  more  consistent  averages  or  sums  in 
such  terms  as  number  of  germinates,  occurrence  of  injury,  number  of  survi- 
vors, and  height  growth,  than  will  samples  of  only  5  or  10  trees.    On  the 
other  hand,  if  smaller  samples  are  used,  more  plot  replications  can  be  made 
with  the  same  amount  of  effort.    The  trick  is  to  strike  a  happy  medium. 
Naturally  the  ideal  balance  differs  for  every  problem.     Specific  sugges- 
tions are  made  in  the  section  at  the  end  which  includes  basic  sample  designs. 

Large  plots  (100  or  more  trees  per  plot)  often  are  more  impressive 
for  demonstration  purposes  and  in  certain  circumstances  they  may  be  impera- 
tive, but  they  add  materially  to  costs  and  usually  add  little  to  statistical 
validity.     Sometimes  large  plots  lessen  the  reliability  of  the  results.  A 
general  rule  might  be:     "When  in  doubt  use  smaller  samples  in  more  replica- 
tions.    If  you  have  200  seeds  or  plants,  a  better  design  is  to  plant  50  in 
each  of  four  replications  than  to  plant  100  in  each  of  two  replications." 

ARRANGEMENT  OF  PLOTS 

Within  a  single  block  or  replication  of  an  experiment,  the  plots 
should  be  as  comparable  as  possible  in  all  respects.  Comparability  should 
include  physical  factors  of  site,  time,  methods  of  planting,  and  condition 
of  the  test  material.  For  instance,  the  soil,  slope,  aspect,  and  vegetation 
should  be  the  same  and  the  trees  should  all  be  planted  the  same  day  by  the 
same  person.  If  more  than  one  man  is  required  to  get  the  job  done,  each 
worker  should  plant  equal  proportions  of  the  trees  in  each  plot. 

If  plots  are  long  and  narrow,  such  as  one  row  of  25  trees,  they 
should  sample  the  full  range  of  any  visible  gradient,  such  as  slope  or 
change  in  depth  of  soil.    For  example,  in  plots  on  a  slope,  rows  should  run 
up-and-down  hill.    The  purpose  is  to  insure  that  each  plot  samples  as  nearly 
as  possible  the  full  range  of  variation  within  the  block.    Plots  should  be 
placed  as  close  together  as  possible  although  allowance  must  be  made  for 
isolation  strips  if  the  treatments,  such  as  applying  fertilizers,  might 
affect  their  neighbors. 

ARRANGEMENT  OF  BLOCKS 

Unlike  plots,  the  separate  blocks  need  neither  be  alike  nor  close 
together.    Usually  there  is  some  advantage  in  deliberately  selecting  blocks 
that  are  some  distance  apart  and  slightly  different.    This  has  the  effect 
of  testing  the  experimental  treatments  over  a  somewhat  greater  range  of 
conditions  (different  soils,  different  slopes,  different  planters,  etc.). 


Blocks  must  not  be  so  different  in  character  that  interactions  are  likely 
to  occur  between  the  experimental  treatments  and  some  condition  that 
affects  the  experiment,  for  example,  species  and  soil  type. 

SPACING  OF  TREES 

For  efficiency  in  layout  of  experiments,  the  spacing  of  trees 
or  seed  spots  should  be  considered  in  relation  to  the  objectives.  For 
example,  if  the  objective  is  to  measure  first  year  survival,  the  trees 
can  be  spaced  only  2  or  3  feet  apart  rather  than  8  or  10  feet  as  in 
standard  planting.     By  placing  the  trees  close  together,  less  space  is 
required,  variability  in  habitat  can  be  reduced,  and  measurement  and 
protection  are  made  easier.    On  the  other  hand,  if  growth  for  5  or  10 
years  is  desired,  closely  spaced  trees  would  compete  among  themselves  more 
than  in  typical  standard  plantings,  so  standard  spacing  should  be  used. 

Border  effects  also  must  be  considered.     For  example,  if  a  plot 
of  fast  growing  hybrids  is  planted  adjacent  to  a  plot  of  slower  growing 
trees,  the  trees  along  the  adjacent  boundary  will  react  differently  than 
in  the  interior  portions  of  the  plots.    The  common  method  to  prevent  border 
effect  is  to  plant  one  or  two  extra  rows  outside  of  the  part  of  the  plot 
that  is  to  be  measured. 

FIVE  BASIC  DESIGNS  FOR  REFORESTATION  EXPERIMENTS 

1.    Field  test  of  initial  survival  in  which  plots  can  be  closely  spaced 
(randomized  block  design). 

Objective :    To  compare  the  effect  of  shade  upon  establishment  of 
2-0  Jeffrey  pine  and  2-0  ponderosa  pine. 

Desired  statistic :    Survival  after  two  growing  seasons  in  field. 

Plan:    One  25-tree  row  of  each  treatment  combination  is  a  plot. 
Six  replications.     Space  trees  3  feet  within  rows,  6  feet  between 
rows. 

Treatment  code :     J,  Jeffrey  pine;  P,  ponderosa  pine;  S,  shade; 
0,  no  shade. 

Replication  or  block  numbers:    B-l,  B-2,  B-3,  B-k,  B-5,  B-6. 
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Field  test  of  survival  and  early  growth  in  ■which  plots  cannot  all  be 
closely  spaced,  such  as  when  plantings  on  burns  and  large  tractor- 
cleared  areas  are  compared  with  those  in  natural  vegetational  cover 
(split  plot  design). 

Objective:    To  compare  survival  and  early  growth  of  three  age- 
classes  of  ponderosa  pine  (l-O,  2-0,  and  2-1)  on  burned  and 
unburned  areas. 

Note :    Since  the  plots  must  be  placed  inside  and  outside  of  the 
burn,  the  assignment  of  treatment  areas  is  not  completely 
independent.    A  split  plot  arrangement,  which  requires  a  slightly 
different  type  of  statistical  analysis,  offers  a  satisfactory 
solution. 


Desired  statistics:    Survival  and  average  height  after  five  grow- 
ing seasons. 
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Plan;    Three  adjacent  rows  of  10  trees  each  for  every  treatment 
combination.     Six  replications.     Space  trees  6  feet  in  rows 
and  6  feet  between  rows. 

Treatment  code:    C^,  1-0  stock;  C^,  2-0  stock;  C  ,  2-1  stock; 

Bn ,  burned  area;  jB  .  unburned. 
1'  tv 

DETAILED  PLAN  OF  ONE  REPLICATION  (BLOCK) 
Edge  of  burn 

3  rows  of  10  trees  each  spaced 
6  feet  X  6  feet 


 clBl  


33' 


 C3  Bl  


  C2  S1   


36'- 


/ 

::{c2 

Bo::: 

E£-~c3 

Burned 


Unburned 


Block  6 


GENERAL  PLAN  FOR  SIX  REPLICATIONS 
Block  1  Block  2 


Block  3 


Unburned 


Block  5 


3.  Field  test  of  long-time  performance  (randomized  block  design). 

Objective :    To  determine  the  performance  (growth,  and  adapta- 
bility to  adverse  -weather  conditions)  of  three  different 
progenies  planted  at  high,  medium,  and  low  elevations. 

Desired  statistics:    Survival  at  5,  10,  and  25  years;  height 
at  5}  10,  and  25  years;  basal  area  per  acre  at  25  years. 

Plan:    Seven  parallel  rows  of  seven  trees  for  each  progeny  plot. 
Trees  spaced  8  feet  x  8  feet.    Three  replications  or  blocks 
at  each  of  three  elevations. 

Treatments  code:    P^,  progeny  No.  1;  P  ,  progeny  No.  2;  P  , 
progeny  No.  3>  E  ,  elevation  1,000  feet,  E  ,  elevation 
3,000;  Ej-,  elevation  5,000  feet. 

DETAIL  OF  ONE  PROGENY  PLOT 


A.  Measure  all  49  trees  at  5  years. 

B.  Measure  central  25  trees  at  10  years. 

C.  Measure  central  9  trees  at  25  years. 


Care  must  be  exercised  to  insure  virtually  100  percent  first - 
year  survival.  Heel~in  (save)  some  extra  trees  from  original  stock  and 
promptly  replace  any  trees  which  fail.    Fence  out  deer  and  livestock. 
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ARRANGEMENT  OF  ONE  BLOCK 

A 


Gradient 
or 
Slope 


P1E3 


P3E3 


P2E3 


Progeny 
plot 


ARRANGEMENT  OF  ALL  BLOCKS 


Block 
Block 
Block 


1 
2 
3 


—  Progeny  plot 
5,600  feet  (E5) 


Block 
Block 
Block 


4 
5 
6 


3,500  feet  (E3) 


Block 
Block 
Block 


7 
8 
9 


1,000  feet  (Ei) 


k.    Same  problem  as  item  3  "but  latin  square  design. 

It  happens  that  this  particular  experiment  could  also  be  designed 
as  a  latin  square  with  only  a  few  minor  changes  in  layout.    This  will  be 
explained  and  illustrated  on  the  following  page. 

In  a  latin  square  the  number  of  replications  must  be  equal  to  the 
number  of  treatments  and  these  must  be  arranged  in  the  form  of  a  square. 
Thus,  with  three  treatments ,  a  total  of  nine  plots  are  required  in  the 
form  of  three  columns  and  three  rows : 
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Columns 


Rows 


With  four  treatments  a  h  x  k  plan  would  be  needed;  five  treatments,  5x5, 
and  so  forth.     Obviously,  if  more  than  six  or  seven  treatments  are  involved, 
the   latin  square   design   would  become  rather  cumbersome.  Ordinarily, 
it  would  not  be  used  in  tree  planting  experiments  if  the  number  of  treat- 
ments exceeded  seven. 

The  second  requirement  of  a  latin  square  is  that  each  treatment 
must  occur  once  in  each  row  and  once  each  column.    Hence,  at  any  one  eleva- 
tional  zone  the  layout  would  be: 


In  the  analysis  of  results  the  latin  square  at  each  elevational 
zone  can  be  treated,  if  desired,  as  a  separate,  complete  experiment,  as 
well  as  a  part  of  the  entire  study  at  all  three  elevations. 

The  principal  advantages  of  a  latin  square  compared  to  a 
randomized  block  design  are  (a)  it  helps  to  insure  distribution  of  any 
habitat  differences  evenly  among  the  treatments,  and  (b)  it  measures 
variance  between  the  treatments  means  more  precisely. 

5«    Nursery  experiment  (randomized  block  design). 

Objective:    To  determine  size  of  1-0  seedlings  grown  at  densi- 
ties of  15,  30>  60,  and  120  trees  per  square  foot. 

Desired  statistics:    Individual  stem  diameters  at  ground  level 
and  total  oven  dry  weights  of  tops  and  roots  at  time  of  lift- 
ing (November  10). 


Plan:    Four  feet  x  four  feet  sections  of  seedbed  will  be  the 
areas  in  which  seedlings  will  be  grown  evenly  spaced  at  the 
specified  densities.    The  50  seedlings  nearest  to  the  center 
of  each  ^-foot  square  will  constitute  the  sample.  Three 
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replications  used.     (Note:    Because  nursery  seedbeds  are  less  variable  in 
environment  than  field  plots ,  fever  replications  and  smaller  plots  are 
required. ) 

LAYOUT  FOR  EXPERIMENT 
Number  of  seedlings  per  square  foot 


15 

30 

60 

120 

30 

60 

120 

15 

120 

15 

30 

60 

Block  1  Block  2  Block  3 

ANALYSIS  AND  INTERPRETATION  OF  DATA 


The  primary  objective  of  designed  experiments  should  be  to  get 
a  quantitative  or  numerical  measure  of  the  effect  of  some  experimental 
variable  or  treatment.    Qualitative  measures  such  as  "slightly  injured," 
"unthrifty,"  or  "small"  are  of  limited  use  for  statistical  analysis  although 
they  may  have  considerable  value  either  to  explain  results  or  for  practical 
application. 

The  first  step  in  analysis  is  to  obtain  the  average  value  of  each 
treatment  and  treatment  combination.    For  example: 


Species   Average  height  after  2  years  

Shaded                 Not  shaded       All  treatments 
  (Feet)-  

Jeffrey  pine  1.0  0.6  0.8 

Ponderosa  pine  1.2  1.2  1.2 

All  species  1.1  0.9  1.0 


This  simple  table  shows  the  occurrence  and  magnitude  of  differ- 
ences among  treatment  effects.     The  important  points  are: 

(a)  Ponderosa  pine  apparently  outperformed  Jeffrey  pine. 

(b)  Jeffrey  pine  apparently  benefited  from  shading,  but 
ponderosa  pine  did  not. 

The  next  thing  is  to  look  back  at  the  data  in  the  several  replica- 
tions to  see  whether  the  differences  are  uniformly  consistent.    For  example, 
if  ponderosa  consistently  outperformed  Jeffrey  pine  and  if  Jeffrey  pine 
consistently  benefited  from  shade,  the  differences  are  probably  dependable. 

The  next  step  is  to  look  back  into  the  field  records  to  see  if 
any  external  cause  might  explain  the  poor  showing  of  Jeffrey  pine,  for 
example,  was  it  more  heavily  browsed  by  deer?    With  regard  to  absence  of 
shading  effect  on  ponderosa  pine,  were  the  shades  possibly  knocked  down  by 
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cows?    Too  small?    At  this  stage,  the  analyst  must  he  extremely  critical 
and  cautious  to  he  convinced  that  ohserved  differences  in  response  were  or 
were  not  influenced  hy  external  conditions.    By  means  of  good  field  records 
and  careful  analysis,  the  experiment  might  have  accidentally  revealed  that 
deer  prefer  Jeffrey  pine  to  ponderosa  pine.    This  could  he  a  valid  although 
unexpected  finding. 

Another  thing  to  consider  in  the  example  we  are  citing  is  the 
bases  from  which  the  average  heights  were  derived.    Suppose  that  90  per- 
cent of  the  Jeffrey  pine  survived  to  age  two  years  hut  only  10  percent  of 
the  ponderosa  pine.    Then  we  might  infer: 

(a)  Poor  initial  survival  of  ponderosa  pine  has  invalidated 
the  study  of  heights  because  only  a  few  of  the  most 
vigorous  trees  survived  and  thus  resulted  in  a  distorted 
picture  of  the  height  growth  of  this  species. 

(b)  Getting  good  initial  survival  of  ponderosa  pine  is  a 
more  important  problem  than  the  effect  of  shade,  or  at 
least,  it  must  be  solved  before  the  effect  of  shade  can 
be  evaluated. 

After  completing  this  critical  review  of  cause  and  effect  rela- 
tions within  the  experiment,  the  analyst  should  consider  the  practical 
consequences.    For  example,  how  important  is  an  average  gain  in  height  of 
O.k-  foot  on  Jeffrey  pine?    Does  it  appear  to  be  worth  the  cost  of  shading 
or  would  a  better  plan  be  to  save  the  cost  of  shading  to  get  more  acres 
planted  with  the  available  funds?    Is  the  faster  initial  start  made  by 
ponderosa  pine  important  enough  to  warrant  using  this  species  to  the 
exclusion  of  Jeffrey  pine  on  the  kind  of  sites  where  the  tests  were  made? 
If  the  answer  to  either  or  both  of  the  last  two  questions  is  "Yes,"  then 
a  statistical  test  may  be  needed  to  determine  if  the  differences  are 
statistically  significant. 

STATISTICAL  SIGNIFICANCE 

Tests  of  statistical  significance  neither  add  anything  to  the 
results  nor  change  the  results.    Nor  do  statistical  significance  tests 
guarantee  that  the  same  experiment,  if  repeated,  will  yield  identical 
results.     These  tests  simply  indicate  what  are  the  odds  that  the  observed 
differences  were  not  due  to  chance  or,  in  somewhat  stricter  statistical 
language,  "The  statement  that  the  treatment  means  are  different  has 
certain  odds  of  being  correct  on  the  average,"  according  to  such  tests. 
For  example,  when  an  analysis  of  variance  indicates  that  a  difference 
due  to  treatments  is  "significant  at  the  5  percent  level, "  this  means 
that  the  odds  are  19  to  1  that  the  observed  difference  resulted  from  the 
treatment  rather  than  from  accident  or  chance. 

If  you  like  odds  of  2:1,  you  are  entitled  to  say  the  results 
are  "significant"  provided  that  you  specify  that  this  is  the  level  of 
confidence  that  you  accepted.    Or  if  you  are  more  cautious  or  strict 
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in  requirement s,  you  may  not  be  satisfied  that  the  results  are  significant 
unless  the  odds  are  499:1  or  even  9>999;1*     The  most  commonly  used  level 
in  forestry  and  similar  sciences  is  19 :1,  but  it  must  be  remembered  that 
this  is  wholly  a  matter  of  judgment  rather  than  a  ratio  which  has  some 
special  mathematical  virtue.     If  human  lives  were  at  stake  we  would  insist 
upon  far  longer  odds.    Methods  exist  by  which  "judgment"  can  be  removed 
from  the  choice  of  level  of  confidence,  but  the  processes  are  laborious, 
presume  much  knowledge  about  the  area  of  work,  and  are  seldom  used  except 
for  very  important  or  expensive  experiments. 

It  is  a  waste  of  time  to  run  tests  of  significance  on  data  that 
are  confounded,  or  invalid  because  of  external  influences.    Also,  no  useful 
purpose  is  served  to  make  such  tests  if  differences  are  either  exceedingly 
large  or  exceedingly  small.    For  instance,  in  a  well  designed  and  well 
executed  experiment  if  the  survival  which  results  from  one  treatment  is 
5  percent  and  from  another  is  95  percent,  you  would  know  immediately  that 
the  difference  was  real,  and  you  should  not  hesitate  to  apply  the  findings 
in  your  program  of  work.    And,  on  the  other  hand,  if  treatment  "A"  resulted 
in  75  percent  survival  and  treatment  "Bj'    7&  percent,  you  would  not  care 
if  the  difference  was  statistically  significant,  because  you  know  that 
dozens  of  uncontrolled  factors  can  cause  planting  survival  to  vary  by  greater 
amounts.     Tests  of  significance  are  helpful  only  when  differences  in  results 
are  big  enough  to  be  possibly  important  but  not  so  large  as  to  be  obviously 
significant. 

No  attempt  will  be  made  here  to  describe  the  steps  in  making 
statistical  tests  for  several  reasons: 

(a)  Calculation  of  statistical  tests  requires  considerable 
training.    Applications  by  unassisted  novices  probably 
would  lead  to  errors  and  cause  wrong  interpretations  of 
the  experimental  results. 

(b)  Many  data  require  special  manipulation  (such  as  transfor- 
mation into  cosines  or  logarithms)  that  is  impossible  to 
explain  briefly. 

(c)  Many  kinds  of  statistical  procedures  are  available  and  no 
one  method  is  universally  applicable. 

Experimenters  who  feel  the  need  to  determine  confidence  limits 
but  lack  the  knowledge  should  present  their  problems  to  mathematics  teachers 
and  scientists  experienced  in  biometrics  for  assistance  in  getting  solu- 
tions. 
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